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ABSTRACT . „ _ 

The development of a simple and effective means ot 

training parents and other non— professionals in the use of a 
home-based instructional program is the concern of this paper. The 
home— based program is the SWRL Parent— Assisted Learning Program 
(PAL) . PAL was created as an adjunct to a broader communication 
skills program. First Year Communication Skills Program (FYCSP) , a 
criterion-referenced instructional program, which includes 
research— based instructional materials and procedures and is designed 
to teach kindergart ners basic reading skills. In developing the PAL 
Parent Guide four basic guidelines were followed: (1) minimizing the 

reading requirements for parents, (2) providing a means for parents 
to practice skills being taught, (3) providing a means for parents to 
evaluate their own learning, and (4) keeping training pro luros as 
brief as possible. The current Parent Guide consists of „es and 

includes the following: (1) a description of the purpos. - he PAL 

Program, the materials included, and other basic information, ^ (2) a 
description of the Practice Exercise and the General Instructional 
Procedures parents are to follow when using the Practice Exercises, 
(3) a series of exercises designed to give parents practice in using 
the General Instructional Procedures, (4) a pronunciation guide 
illustrating how the Program Words and Word Elements are sounded out 
and procedures for practicing the pronunciation of them. It was 
determined that the procedures used were successful in producing a 
low-cost guide. (CK) 
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THE DEVELOPMENT AND EVALUATION OF A PARENT TRAINING MANUAL FOR HOME 
INSTRUCTION 

Nancy Yainan and Ralph A* Hanson 

ABSTRACT 

The results of a study designed to evaluate a self -instruct ional 
manual for training parents are presented. Included is a description 
of the development of the manual, evaluation procedures used and results 
obtained. The procedures should be useful to others planning and pre- 
paring training guides for parents. 




i 



3 



THE DEVELOPMENT AND EVALUATION OF A PARENT TRAINING MANUAL FOR HOME 
INSTRUCTION 1 

Nancy Yaman and Ralph A. Hanson 



Recent s ies suggest that learning which occurs in a child’s 
home influencL his development of school-related skills and abilities 
(Passow, 1970; Coleman et al. , 1966; Stodolsky, 1965; Hess and Shipman, 
1965; Bloom, 1964; Wolf, 1964; Dave, 1963; Hunt, 1961). Communication 
skills and abilities related to reading and speaking are among those 
influenced by home learning (Bernstein, 1966). Educators are therefore 
attempting to involve parents directly in the achievement of school 
objectives for communication skills through home-based, parent-child 
instructional programs designed to supplement the child's school learn- 
ing experiences. Research carried out at the Southwest Regional Labora- 
tory (SWRL) indicates that the following problem areas must be resolved 
before home-based instructional programs can function effectively: 



1. Development of program materials and procedures for parents 

to use with their child that are related to school objectives. 

2. Development of a simple and effective means of instructing 
parents and other non-professionals in the use of a home- 
based instructional program. 

3. Distribution of program and training materials to parents. 

4. Monitoring of program progress. 

The second problem area, the development n f a simple and effective 
means of training parents and other- nor- ~-ro- r cssi' 1 11 £h-\ use c- r a 

home-based instructional puug-.- , ia ^cie concern of this piaper. 

The home-based instructional program for which SWRL's version of a 
parent training manual is intended is the SWRL Parent -Ass is ted Learning 
Program (PAT.) , The present method for training parents to use the PAL 
Program has progressed over the last two years from an ad tioc presenta- 
tion for parents attending school meetings to successful parent self- 
training in the home through the use of the PAL Parent Guide. The 
specific procedures used in developing and validating the PAL Parent 
Guide and the results of a small tryout study evaluating its effectiveness 
are outlined in this paper. 

SWRL developed the PAL Program as an adjunct to its yet broader 
communication skills program known as the First Year Communication Skill: 

A 

Ipaper presented at the Annual Meeting of the California Educational 
Research Association held in San Diego, California on April 29 and 30, 
1971. 
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Program (FYCSP) . The following contextual summary of the FYCSP and PAL 
Program is provided so that the actual development and evaluation of 
SWRL's parent training manual — the PAL Parent Guide — can be followed 
more readily. 

The First Year Communication Skills Program . The FYCSP is a 
criterion-referenced instructional program which includes research- 
based instructional materials and procedures, and is designed to teach 
kindergarten children basic reading skills. The program enables system- 
atic teaching of these basic reading skills to kindergarten children. 

The four specific objectives of the FYCSP are that children learn to: 

1. Read 100 words 

2. Read 23 initial and ending sounds 

3. Sound out and read any one-syllable word composed of word 
elements from the program 

4. Identify each letter of the alphabet presented either in 
lower or upper-case type 

The Parent-Assisted Learning Program . The PAL Program provides the 
child weekly, additional practice on the skills being taught in the FYCSP. 
It consists of a set of both instructional and training materials. The 
instructional materials are sent home each week by the teacher for use 
by the parents and their child. During the practice sescions parents 
use Practice Exercises and Learning Games to provide practice and review 
on the specific content of the four FYCSP outcomes completed by the child 
during the prior week i f 1 clap 

PAL is designed for approximately one hour's use per week. Fifteen 
minutes are spent administering a Practice Esrarci.se on each of the first 
three days of the week. On the fourth day, a -.earning Game is played. 

Each Practice Exercise contains 20 items-. n accompanying script 
instructs the parent how to administer each ircem to the child* The 
parent's questions elicit a selected or constructed pupil response to 
a printed word, letter, or word element. Pamsnt s go through the items 
with their child twice during each Practice Session. 



Development of the PAL Parent Guide 



In developing the PAL Parent Guide, a livn of specific objectives 
was drawn up which included inf on ation parems should know about the 
pxogiam ant procedures they should follow during a Practice Session. The 
specific infor m ational and procedural objectives are given in Appendix A. 
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In actually preparing the Parent Guide, four basic guidelines were 
followed : 



1. Minimizing the reading requirements for parents. 

2. Providing a means for parents to practice skills being taught. 

3. Providing a means for parents to evaluate their own learning. 

4. Keeping training procediires as brief as possible. 

By following the guidelines, the training objectives of the PAL 
Program were incorporated into a Parent Guide. Once the prototype 
Parent Guide was completed, an in-house pilot study was conducted using 
Laboratory personnel to pretest its effectiveness. Several persons 
read the Guide as a parent would, and then conducted a simulated Practice 
Session. Based on the results of this pilot study, several revisions 
in t:he Guide were made . 



The revised Parent Guide consists of a total of 10 pages and 
covers the following: 



1 . A description of the purpose of the PAL Program ^ materials 
included, and other basic Program informatic - 

2. A f ascription of the Practice Exercise and the General Instruc- 
tional Procedures parents are to follow when using the Practice 
Exercises - 

3 a series of exercises designed to give parents practice in 
using the General Instructional Procedures. 

4. A pronunciation guide illustrating how the Program Lords and 
Word Elements are sounded out and procedures for practicing 
the pronunciation of them. 

5. A description of the three PAL games and procedures for using 
them. 

6 . A Question-Answer Sheet containing questions parents often 
ask about PAL and the answers to them. 

Sample and Study Procedures 

The next step was to conduct a tryout study to determine the effec- 
tiveness of the Parent Guide. A major concern in developing PAL training 
procedures was to ensure that all English speaking parents with minimal 
reading skills could effectively use the Program. Therefore , an important 
criterion for the selection of the study sample was that the subjects 
had reading abilities which approximate the minimal level of parents who 
would be using the PAL Guide. 
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Twenty seventh- and eighth-grade students from a local school 
participated in the tryout. The reading ability of these students, 
as measured by the California Test of Basic Skills, ranged from the 
sixth- to eleventh-grade level, comparable to or less than that of 
parents who would be using the PAL Guide. Due to space limitations 
and the extensive individual testing required, only four sessions were 
held. An evaluation agenda and training guide were prepared for SWRL 
staff to follow so that identical input was given to all groups. 



Evaluation of the PAL Parent Guide 



The students were evaluated individually immediately after they 
finished studying the Parent Guide. Three instruments were used to 
evaluate their learning. Figure 1 lists their type, content, and the 
specific measurement procedures used. The three instruments can be 
found in Appendix B. 



Figure 1 

EVALUATION INSTRUMENTS 



Instrur^nt 



IZBi 



Measurement Procedures and Content 



1. Evaluation of 
Word Elements 
and Program 
Words 



Observation The students were handed a list 
Checklist of 10 Program words to be sounded 

out and read. The evaluator 
recorded the correct and incorrect 
verbal responses . 



2. Practice Exercise Observation 

and Game Evalua- Checklist 

tions 



The checklist included all of the 
behaviors parents were expected 
to exhibit during a Practice 
Sec^.-.cn. The students were to 
conduct a simulated Practice 
Session in which they played the 
role of the parent. The evaluator 
played the role of the child and 
recorded the students correct 
and incorrect behaviors. 



3. Parent Test 



Paper and This test included twelve questions 

Pencil which covered basic information 

about the PAL Program included 
in the Guide. 
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Results 

Table 1 illustrates the performance of subjects with different 
grade e™iva)ent scores in reading on all three evaluation instruments. 

The data include the means and percentage of correct responses made on 
each measure . 

The data in Table 1 reveal that pupils with higher grade equivalent 
The data n •, with lower grade equivalent scores on 

' l!^ te s t ^ f ° However ^ only at the extremes were the differences substantial. 

The correct responses for pupils at the sixth-gr ade rea J“ 8e 
between 42% and 59%, whereas for pupils reading at the eleven -n grace 
level they ranged between 70% and 83%. The average performance on al 
SS ranged from 60% through 75% indicating that the subjects as a 
group were able to learn a major portion of the informational and pro 
cedural objectives presented in the ; ^rent^uide. J^was ^ ^ 

behavior s^hat we^e^S ^rmed on ea’h of the 

difficulty f about S th/?I L e progra; admeasured by the Parent 

of basic information about tne ran * pnrrpp t behaviors 

su“: ssiS s^rs^snr^ccLrs^ise 

de termine 11 which 8 specif ic betoviors were most difficult to lesru Wables^^ 
2, 3, and 4). These data were used as the basis for su s q 
to the Parent Guide. 

T-T,,- o illustrates performance on the Parent Test, which measured 
taowladgi of basic '"information about the PAL Program The results show 

Sat' the majority of the test components “ ° ems . 

the subjects. Test performance was poor on only three of tne test 

Table 3 shows the results of the Evaluation of Word Elements and 

Progam »rds. Twenty-seven of the 30 test components were answered 

correctly hy the majority of the subjects The two ^mSt S expected , 

to sound out were the J^er ^sounding^t 

reading the word proved consideraDiy easier l.u ““=> 

the beginning and ending word elements. 

rp-L p. performance of the students while conducting a simulated 
Practice Session is given in Table 4 Thisincludes^both^the^valuation 
nf the Practice Exercise Session and Game Playing- > 

sented i”m by item, indicate that a wide variation in the number of 
SSect responses occurred in the Practice Exercise Evaluation. Tne 
items answered correctly ranged from 22% to yy% . 

Most of the behaviors the students were expected to ^hibit during 

the Game Evaluation were identical to those included in the Practic 
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Table 1 



Assessment of PAL Parent Guide Learning 
by Three Evaluation Instruments 



Reading 

Level 


N 


Mean and Percentage 


of Correct Responses 


Game 3 

Evaluation 


Parent 

(max= 


Test 

12) 


Word Elements & 
Program Words 

^LuaA -3 0 ) 


Practice Exercise 
Evaluation 3 
(max=53) 


X 


% 


X 


% 


X 


% 


KcoX 


% 


6 


4 


5.6 


(46.9) 


17.5 


(58.3) 


31.5 


(59 .4) 


47 


(42.4) 


7 


3 


8.8 


(73.6) 


27.3 


(91.1) 


39.3 


(74.2) 


38 


(70.2) 


8 


3 


7.0 


(58.3) 


14.3 


(47.8) 


43.7 


(82.4) 


45 


(51.0) 


9 


4 


9.8 


(81.2) 


27.5 


(91.7) 


42.8 


(80.7) 


57 


(66.7) 


11 


4 


9.6 


(79.6) 


25.0 


(83.3) 


43.3 


(81.6) 


62 


(70.0) 


Total 


18 


8.2 


(68.1) 


22.5 


(75.0) 


39.9 


(75.4) 


249 


(60.0) 



each group, and ,, % M represents the average of the percentage of correct 
responses made by each individual within each group. 

a Pract ice Exercise and Game Evaluations is normally considered to be one 
evaluation instrument, but is treated separately here for the purpose of 
data analysis. 
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Table 2 

Item Analysis of the Parent Test 
(18 subjects) 



Item 



Item Content 



10 



11 



What is the PAL Program 
designed to do? 

Who should use the PAL 
mater ia Is ? 



How much time each week 
does the program take? 

How much time each day 
do you spend with your 
child? 



How and when do you 
receive the program 
ma ter ial s? 



When do you start the 
program (including what 
day) ? 



What are the two types 
of materials that you 
use with your child? 

Which days do you spend 
on the Practice Exercises? 

Which day do you spend on 
the Learning Game? 

How many Practice Exer- 
cises and Games do you 
receive each week? 

When do you use the 
follow-up activity? 



Correct Item Response 


N 


% 


Help parent assist the 
child in learning to read 


16 


88.9 


a. The parent and child 


12 


66.7 


b. If parent is unable to 
do so, then another 
adult in the home may 
do so 


5 


27.8 


1 hour (4 days) 


15 


83.3 


15 minutes 


17 


94.4 


a. You receive them from 
the child's teacher 


13 


72 . 2 


b. On a Monday 


12 


66.7 


a. As soon as you receive 
the materials 


12 


66.7 


b. On a Monday 


14 


77.3 


a. Practice Exercises 


16 


88.9 


b. Learning Gamas 


14 


77.8 


Mondays , Tuesdays , and 
Wednesdays 


12 


66.7 


Thursdays 


14 


77.8 


Four 


11 


61.1 



When the child does as 
well or better the second 
time through the Practice 
Exercise t 



6 33.3 

(partially correct) 

2 11.1 

(completely correct) 



] 2 Maine some follow-up 

activities? 



(Any 3 of the follow-up 
activities listed in 
the Parent Guide) 



0 0.0 

(named just 1) 

1 5.6 

(named just 2) 



8 44.4 

(named 3) 
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Note : 



N=number of correct responses; %= percentage of correct responses. 



8 



Table 3 



Item Analysis of Word Elements and Program Words 
(18 subjects) 


Item 


Item 


Content 


Beginning 

N 


Sounds 

% 


Ending 

N 


Sounds 

% 


Program 

N 


Words 

% 


i 


m - 


an 


12 


66.7 


14 


77.8 


16 


88.9 


2 


s - 


at 


13 


72.2 


14 


77.8 


16 


88.9 


3 


n - 


et 


12 


66.7 


14 


77.8 


16 


88.9 


4 


sh 


- ut 


13 


72.2 


14 


77.8 


16 


88.9 


5 


b - 


ad 


12 


72.2 


14 


77.8 


16 


88.9 


6 


h - 


111 


9 


50.0 


14 


77.8 


16 


88.9 


7 


f - 


ell 


10 


55.6 


12 


66.7 


15 


83.3 


8 


th 


- an 


9 


50.0 


13 


72.2 


16 


88.9 


9 


w - 


■ eed 


13 


72.2 


14 


77.8 


16 


88.9 


10 


r - 


• tin 


7 


38.9 


13 


77.2 


16 


88.9 



Note: N = number of correct responses; % = percentage of correct responses. 
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Table 4 




Item Analysis of the Practice Exercise and Game Evaluations 
(18 subjects) 



Practice Exercise ^ 

Evaluation 3 Game Evaluation 



I tern 


Item Content 


max 


N 


% 


max 


% 


1 


Was the Practice Exercise placed directly 
in front so that you could hold it and 
turn the pages? 


18 


9 


50.0 


- 


- 


2 


Was the parent pleasant and relaxed? 


18 


16 


88.9 


18 


94.4 




Did the parent 












3 


Open with a positive remark? 


18 


10 


55.6 


18 


44.4 


4 


Read the directions correctly? 


216 


201 


93.1 




- 


5 


Confirm the correct responses when the 
child gave the right answer? Also praise 


144 


142 


98.6 


41 


81.9 




after 3-4 correct answers? 














When the child gave the wrong answer or 
no answer at all, did the parent 












6 


Tell you what the word was that you pointed 
to? 


18 


12 


66.7 


- 


— 


7 


Ask you to look at the word? 


54 


12 


22.2 


34 


11.1 


8 


Point to and/or tell you the right answer? 


72 


66 


91.7 


34 


91.7 


9 


Have you point to or say the right answer? 


72 


45 


62.5 


34 


47.2 


10 


Confirm the correct responses? 


7 2 


44 


61.1 


34 


50.0 




Did the parent 












11 


Record the answer correctly? 


216 


155 


71.8 


- 


- 


12 


Correctly total the number of correct 
or incorrect items? 


18 


4 


22.2 


— 


— 


13 


Say something like "You got 8 right this 
time, if you get 8 or more items right 
on Trial 2 we will have a follow-up 
act ivity "? 


18 


5 


27.8 






14 


Explain the rules to the child correctly? 


- 


- 


- 


18 


55.6 


15 


Follow the game procedures correctly? 


- 


- 


- 


18 


72.2 



3N = number of correct responses; % = percentage of correct responses , 

. ^ 
b The number of opportunities for each individual to respond varied on the Game Evaluation. // 

max - represents- the total number of opportunities presented to the group as a whole for 

each item. . _ 

% _ represents the average of the percentage of correct responses made by each individual 

in the group by item. yr 
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Exercise Evaluation. Generally speaking, the results were similar with 
slightly lower performance occurring on the Game Evaluation. 

Discussion and Summary 

The results of this tryout indicate that the prototype Parent Guide 
was successful in instructing pupils to use the PAL Program. The read- 
ing levels of the participants varied from the sixth to eleventh grade, 
although the variance in their performance was minimal. More important, 
however, the item analysis of the three evaluation measures revealed 
specific areas of poor performance. Based on these resuJ ts the following 
decisions we ^ z made : 

1. indicated by the Parent Test, the majority of the questions 
1 -fir q with basic PAL Program information were answered com- 
pletely or at least partially correct by most of the subjects. 
Information from two of the items where the correct pupil 
responses were less than 50% were presented in visual as well 
as written form in the revised Guide. 

2. The majority of the test components were correctly sounded out 
and read as indicated by the evaluation data. Therefore, no 
revisions were felt necessary in this area. 

3. Results of the Practice Exercise and Game Evaluations indicated 
that some of the General Instructional Procedures were much 
more difficult to learn than others. Pvevisions Were made in the 
General Instructional Procedures so that they are now presented 
visually as well as in written form. The Procedures were placed 
in the Guide so that they can be easily removed and used as a 
wall chart, serving as a constant reminder to parents to use the 
correct procedures. 

Conclusions 



The procedures described in this pap^r were successful in producing 
a low cost Guide for training parents in the use of a home-based instruc- 
tional program. Presently data are being gathered on the effectiveness 
of the revised version of the Parent Guide. An additional developmental 
effort is being made to prepare training materials which will allow non- 
English speaking parents to use the PAL Program. 
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Appendix A 




I. Information Objectives 

Parents will learn the following facts: 

1. The PAL ,ram is designed to help the parent assist his 

child in 1 es/ . m ng to read. 

2. The PAL manerimls si mid be used by parent and child. An 

older brother, sister or another adult living in the home 
may use th~ iai.i if the parent i-S utmble to c,o so. 

3. The program r^<raires 15 minutes of time each day, four days 
a week (approx^ mat eLj 1 hour). 

4. PAL materials are tc oe sent home by the teacher with the 
child on a Ifcr.cay. 

5. The program starts cm the first Monday after the materials 
are sent home. 

6. There are two types of PAL instructional materials „ Practice 
Exercises and Learning Games. 

7. Monday, Tuesday, and Wednesday are spent on the Practice 
Exercise. Thursday is spent on the Learning Game. The 
parent receives 3 Practice Exercises and 1 Learning Game 
each week. 

8. A follow-up activity should be used when the child does as 
well or better the second time through the Practice Exercise. 

9. The type of follow-up activities chosen should be based on 
the child T s preference. 

II. Procedural Objectives 

Parents will be able to : 

1. Be pleasant and natural before the practice session. Place 
the Practice Exercise directly in front of the child. Have 
him sit on the parent’s right and allow him to hold it and 
turn the pages. 

2. During the practice session: 

a. When C:;e. child gives a right answer, let him know he 
is rri^hn by saying ’’Good” or That’s right.” Also, 
pramse ml m after 3 or 4 correct answers. 
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b. When the child gives a wrong answer or no answer at 
all, ask him to look at the word. Tell him the right 
answer. Have him say the right answer before going 
on . 



3. Record a correct response male by the child, by circling 
the plus (+) sign next to tb appropriate item under Trial 
1 or 2 (depending on whether , - is the 1st or 2nd time 
through the Practice Exercised „ 

Record an incorrect response made by the child by circling 
the minus (-) sign next to the appropraite item under 
Trial 1 or 2. 

4. After going through a Practice Exercise tell the child that 
if he does as well or better the second time he will receive 
a follow-up activity. 

5. Pronounce these 11 beginning sounds correctly: m, s, n, 

sh , b , h , 1 , f , th , w , and r . 

6. Pronounce these 11 ending sounds correctly: at, it, eed , 

ut, ell, ad, et, eet, at, ill, an. 

7 . Sound out all program words consisting of the beginning 
and end ing sound s in 5 and 6 . 

8. Play these three learning games: Tic-Tac-Toe, Remember, 

and Fish, following the same procedures as during a 
practice session. 
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Appendix B 



WORD ELEMENTS AND PROGRAM WORDS 
REVIEW OF BEGINNING AND ENDING SOUNDS 



Directions: Sound out and say each of these words 

man 

sat 

net 

shut 

bad 

hill 

fell 

than 

weed 

run 
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PARENT TEST 

Directions: Please answer the quest Lons below usin^ the information 

from the Parent Guide. 

1. What is the PAL Program designed to do? . 



2. Who should use the PAL materials? 



3- How much time each week does the program take? 

4. How much time each day do you spend with your child? 

5. How and when do you receiye the PAL materials? 



6. When do you start the program? (including what day) 



7. What are the two types of materials that you use with your child? 

1 . 

2 . 

8 . Which days do you spend on the Practice Exercises? ‘ 

9. Which day do you spend on the Learning Game? 

10. How many Practice Exercises and Games do you receive each week? 

11. When do you use the Follow up activity? __ 

12. Name some Follow up activities. 
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School : 



Pupil : 



Grade : 



Da te : 



EVALUATION OP WORD ELEMENTS AND PROGRAM WORDS 



Directions: "While using the Practice Exercises and Gaines, you should 

be able to sound out correctly the beginning and ending 
sounds of the program words . Here is a list of some of 
the words you will need to know (HAND THE PARENT THE WORD 
ELEMENTS SHEET) . Please sound out and say each of these 
words - 1f 



1 . m an 

+ - + - 

2. s at 

+ - + - 

3. n et 

+ - + “ 

4 . sh ut 

+ - + - 



5. b ad 

+ - + - 



6. h ill 

4 - - + - 

7. f ell 

+ - + ~ 



+ - 8. th 

+ - 

+ - 9. w 

+ - 

+ - 10- r 

+ - 

+ - 
+ - 
+ - 
+ - 



an + - 

+ - 

eed + - 

4 - - 

un + “ 

4 - - 




\ 
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EVALUATION OF PAL IN-HOUSE 
TRAINING SESSION 
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Did the parent open with a positive remark? 
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"Now let's play the 'Remember 1 Game. As I did during the Practice Exercise, I will sometime give the right 
answer and other times the wrong answer or no answer at all. Once again follow the procedures you were 
instructed to use in the Parent Guide." — — 
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